APPARATUS FOR REDUCING ZIPPER OF IMAGE AND 

METHOD THEREOF 



1. FIELD OF THE INVENTION 

5 This invention is related to an image processing method, and more 

particularly, to a method and an apparatus using a recovery model to reduce 
the zippers of image. 

2. DESCRIPTION OF RELATED ART 

10 Nowadays, digital scanners, digital still cameras and digital 

camcorders become more and more popular in the daily life. However, 
because of some limitations in processing the digital image, the quality of 
the digital image is not as good as the traditional photo. 

One of the limitations is the zipper of image. Figure 1 demonstrates a 
15 typical example of the zipper of image. The detailed description of the 
zipper is described as follows. 

Figure 2 briefly illustrates the operation of a CCD. The Charge 
Coupled Device (CCD) comprises an odd image sensor 11 and an even 
image sensor 12. The output signals from the odd image sensor 11 and the 
20 even image sensor 12 are combined to form a mixed output signal 10. 
Thus, data of a horizontal line comprises the output of the odd image sensor 
1 1 and that of the even image sensor 12. 

Figure 3 shows the arrangement of pixel data of the horizontal lines. 
In this figure, the odd image sensor 11 and the even image sensor 12 are 

25 arranged in parallel and have a gap in between. When the width of the gap 
is equal to the thickness of a line, the even image sensor 12 senses the even 
pixels of line 0 whereas the odd image sensor 1 1 senses the odd pixels of the 
line 2. The output sequence of the time 1 will be POO, P21, P02, P23, P04, 
P25 etc.; the output sequence of the time 2 will be PIO, P31, P12, P33, P14, 

30 P35 etc.; the output sequence of the time 3 will be P20, P41, P22, P43, P24, 
P45 etc. and so forth. Thus, the whole image will be obtained. 

If the region of the Figure 3 is white, the output at time 1 will be that 
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shown in Figure 4A. If the region of the figure 3 is black, the output at 
time 1 will be that as shown in Figure 4B. If the line 0 of the figure 3 is 
black and the line 1 and up are white, the theoretic output data will be that 
shown in Figure 4C. However, because the adjacent voltages interfere 
5 each other and the charge change cannot be very fast, the real output will be 
that as shown in Figure 4D. The high voltage Vh is less than the standard 
high voltage Vw, the low voltage Vi is higher than the standard low voltage 
Vb. After combining the output of the odd and even image sensors, the 
output of the Line 0 will be that as shown in figure 4E and the output of the 
10 line 2 will be that as shown as Figure 4F. Because of the differences of the 
acquiring time, the voltages of the adjacent pixels are different. Thus, the 
quality of the color is faded. This phenomenon is called zipper on the 
edges of image. As shown in Figure 1, at the region when there are large 
differences in the color grades, the zipper phenomenon is presented. 

15 The conventional method uses the averaging method to solve the zipper. 

In the averaging method, the voltages of the adjacent pixels are averaged. 

As described in figure 3, the line 0 is black and the line 1 and up are white. 

In the averaging method, the value of (P00+P01)/2 is assigned to POO, the 

value of (P01+P02)/2 is assigned to POl, and so forth. Thus, the output of 
20 the Line 0 will be that shown in Figure 5A, and the output of the Line 2 will 

be that shown in Figure 5B. 

The Zippers disappear. In comparison with the Vh and VI, the Vah and 
the Val are closer to the Vw and Vb respectively. Thus, the phenomenon of 
the color fading is reduced. However, although the phenomenon of zipper 
25 and the color fading is reduced, the averaging method will distort the color of 
the image. This invention provides a better method to reduce the zippers 
without distorting the color. 

SUMMARY OF THE INVENTION 

30 The primary object of this invention is to provide an apparatus and a 

method to reduce the zippers of image. This invention uses a recovery 
model to improve the quality of the image data. 

The secondary object of this invention is to solve the color distortion in 
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the averaging method. 

In a preferred embodiment, the present invention discloses a method 
for building a recovery model. The recovered model can be obtained by the 
steps of: (A) producing a plurality of outputted signals according to a 
5 plurality of brightness, wherein the brightness are not all the same; (B) 
measuring a plurality of differences according to the outputted signals and a 
plurality of theoretical signals corresponding to the brightness; (C) 
establishing an interference model according to the differences; and (D) 
producing the recovery model according to the interference model, 

10 A preferred embodiment to use the recovery model for reducing the 

zippers of image in accordance with the present invention comprises the 
steps of: receiving a pixel data of an image data; calculating the pixel data 
by the recovery model according to a difference of the pixel data and at least 
one adjacent pixel data; and repeating the receiving and calculating steps 

15 and producing a recovered image data form a plurality of calculated pixel 
data. 

The apparatus for reducing a zipper of image comprises a recovery 
module and a processing logic. The recovery module stores a recovery 
model having a plurality of recovery parameters. The recovery parameters 
20 are corresponding with the zipper. The processing logic is coupled to the 
recovery module for receiving a digital image data. The processing logic 
also calculates the digital image data with the recovery parameters to 
produce a recovered image data. Wherein, the zipper of the recovered image 
data is better than that of the digital image data. 

25 The various objects and advantages of the present invention will be 

more readily understood from the following detailed description when read 
in conjunction with the appended drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 Figure 1 shows the zippers of the image data. 
Figure 2 shows the block diagram of a CCD. 

Figure 3 shows the arrangement of pixel data of the horizontal lines. 
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Figure 4A is an output of an image sensor when sensing the white regions. 

Figure 4B is an output of an image sensor when sensing the black regions. 

Figure 4C is a theoretic output of an image sensor when the differences of 
the color grades are big. 

5 Figure 4D is a real output of an image sensor when the differences of the 
color grades are big. 

Figure 4E is the output when the line 0 is affected by the zipper 
phenomenon. 

Figure 4F is the output when the line 2 is affected by the zipper 
10 phenomenon. 

Figure 5 is the output of the line 0 in the averaging method. 

Figure 5B is the output of the line 2 in the averaging method. 

Figure 6A is the block diagram of the cause of the zipper phenomenon. 

Figure 6B describes the principle of this invention. 

15 Figure 6C shows an equivalent block diagram of the Figure 6B. 

Figure 7A shows the flowchart of using a statistic method to calculate the 
recovered model in the invention. 

Figure 7B shows an embodiment of the recovered model of the invention. 

Figure 7C shows the flowchart of using the Neural Network method to 
20 calculate the recovered model. 

Figure 8 shows a flowchart of operation in this invention. 

Figure 9 shows a result of using the recovered model of this invention to 
reduce the zippers of an image data. 

Figure 1 OA shows a block diagram of a first embodiment of this invention. 

25 Figure lOB shows a block diagram of a second embodiment of this 
invention. 

Figure IOC shows a block diagram of a third embodiment of this invention. 
BRIEF DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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The block diagram in Figure 6A shows the cause of the zipper 
phenomenon. The real signal 60 from the image sensor is interfered and 
becomes a distorted signal 61 with a zipper output therefrom. The 
5 interference is modeled as an interference model 65. The mixed output 
signal 10 in Figure 2 is the distorted signal 61. The real signal 60, 
interference model 65, and the distorted signal 61 are denoted as x, A and y, 
in respectively. The relation of x, A and y can be mathematically described 
as: 

10 

y = Ax Equation 1 

Figure 6B describes the principle of this invention. This invention 
uses a processing apparatus to overcome the zipper before outputting a 

15 recovered signal 62 so that the recovered signal 62 is similar to the real 
signal 60. A recovered model 66 is estimated and neutralizes the 
interference model 65. Because the recovered model 66 neutralizes the 
interference effect of the interference model 65, the quality of the recovered 
signal 62 is better than that of the distorted signal 61 . The recovered model 

20 66 and the recovered signal 62 are denoted as B and r, in respectively. The 
relation of r, B and y can be mathematically described as: 

r = By Equation 2 

25 We can produce r = BAx according to equation 1 and equation 2 

We assume B= A'^ , because B neutralizes the effect of A 
r = A'^Ax 
Thus r = X 

30 After using the recovered model 66 to neutralize the interference model 

65, the recovered signal 62 will be approximately equal to the real signal 60. 
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As shown in Figure 6C, the zipper is reduced. 

According to the above descriptions, the parameters of the recovered 
model 66 will influence the effect of the zipper reduction. Thus, 
establishing a good recovered model 66 is beneficial. The recovered model 
5 66 can be established according to the statistic, or the mathematic 
polynomial methods. An embodiment of this invention uses the statistic 
method. In the embodiment, the statistic method is for analyzing the errors 
and the distributions based on the real data. In the embodiment, the statistic 
model which also called Nearly Decoupled Model is popular in academic 
10 and industrial applications. 

The basic principle of the method for building the recovery model in 
accordance with the present invention generally comprises the following 
steps: 

(A) producing a plurality of outputted signals according to a plurality of 
15 brightness, wherein the brightness are not all the same; 

(B) measuring a plurality of differences according to the outputted 
signals and a plurality of estimated signals corresponding to the brightness; 

(C) establishing an interference model according to the differences; and 

(D) producing the recovery model according to the interference model. 

20 Detailed embodiment for establishing and performing the method 

described above can be illustrated by Figures 7A and 7C. Figure 7A shows 
the flowchart of using a statistic method to calculate the recovered model 66. 
This invention designs the following steps to establish the recovered model 
66: 

25 Step 71 : setting the voltages of the brightest and darkest brightness. If the 
brightest voltage is higher, the zipper of image would be more serious. 
If the brightest voltage is lower, the amount of grades for presenting the 
colors of image will become less which affects the quality of the color. 

Step 72: setting a type of light source and the properties of the odd image 
30 sensor 11 and the even image sensor 12. Because the colors are 

composed of red, green and blue, and these three colors are 
independent, therefore the recovered models of each of the three colors 
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can be calculated individually. Because the modes of sensing can be 
either from brightest to darkest or from darkest to brightest, the 
recovered models of each of the three colors will be calculated 
separately at both modes. The completed recovered model 66 can be 
5 established by combining the recovered models of each of the three 

colors at two different modes. 

Step 73: producing a measured voltage according to an input brightness 
and measuring and recording the voltage difference according to the 
measured voltage and a theoretical voltage corresponding to the input 
10 brightness. Although the zipper is not sever when the voltages are not 

at high or low peaks, the image will still be affected. In order to 
obtain a precise recovered model, the distorting is measured not only on 
peaks voltages but also in between. 

Step74: checking if the number of input data is enough according to the 
15 statistic model. If the number of input data is not enough, it will 

retum to the step73. If the number of input data is enough, it will 
proceed to the step75. 

Step 75: using a mathematic method to establish the interference model 65 
according to the voltage differences obtained from the step 73. 

20 Step 76: producing the recovered model 66 from the interference model 

65 obtained from step 75. Wherein the recovered model 66 is used to 
neutralize the effect of the interference model 65, the recovered model 

66 is an inverse function of the interference model 65. 

25 The recovered model 66 or the interference model 65 can be calculated 

by the Neural Network, Fussy Logic, Matrix Model or Nearly Decoupled 
Model. The parameters of the recovered model 66 or the interference 
model 65 can be calculated by a Neural Network, the Least Square Method, 
Optimization Method or Method ° 

30 Figure 7B shows an embodiment of the recovered model 66 in this 

invention. The embodiment comprises three layers of neural networks. It 
is assumed that there are m sets of data obtained from step 73. As shown 
in Figure 7B, when calculating the recovered model 66, the distorted signal 
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61 with a length of n input to the input stage units 660 660n of an input 
stage 660 of the neural network and multiply with a first weight, 
respectively. The first stage unit 661 1 of the first stage neural network 661 is 
the sum of each of the output of the input stage units 6601-660n. In other 
5 words, the unit 661 1 of the first stage neural network 661 is the sum of each 
of the first stage units 6601~660n multiplied with the first weight. The 
first stage unit 6612 of the first stage neural network 662 is the sum of each 
of the input stage units 6601~660n multiplied with the first weight. Thus, 
these first stage units 661 1-^ 66 In of the first stage neural network 66 lean be 
10 obtained. The set of the first weight 666 is denoted as Wi and the initial 
values of the set of the first weight 666 are random values. 

The set of the second weight 667 located between the first stage 661 
and the second stage 662 is denoted as W2. The set of the third weight 668 
located between the second stage 662 and the third stage 663 is denoted as 

15 W3. The set of the fourth weight 669 located between the third stage 663 
and the output stage 664 is denoted as W4 and the initial values of the set of 
the fourth weight 669 are random values. Thus, the output stage 664 of the 
neural network outputs an output signal 665. The sets of the weight 666—669 
are reversely modified according to a difference between the output signal 

20 665 and the real signal 60. In other words, firstly, the set of the fourth 
weight W4 is modified according to the difference; secondly, the set of the 
third weight W3 is modified according to the set of the modified fourth 
weight W4 ; and so forth . Please refer to Figure 7C, Figure 7C shows the 
flowchart of using the Neural Network method is for calculating the 

25 recovered model 66. The flowchart in Figure 7C is an embodiment of the 
step 76 in the Figure 7A. The step 76 comprises the steps of: 

Step 760: setting the tolerance value. The tolerance value refers to the 
maximum tolerant differences between the output signal 665 and the real 
signal 60. If the differences between the output signal 665 and the real 
30 signal 60 is larger than the tolerance value, the neural network needs 

further leaming. If the tolerance value is set to be over large, the quality 
of the recovered model 66 will be bad. If the tolerance value is set to 
be too small, there is possibility of failing to obtain the recovered model 
66. 
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Step 761: setting the value of i to be 1 so the processing will start from the 
first data. 

Step 762: inputting this i^*^ data to the neural network as shown in figure 7B. 

Step 763: outputting the output signal 665. 

5 Step 764: checking if the difference between the output signal 665 and the 
real signal 60 is within the tolerance value. If yes, the recovered model 
66 will not be modified and the step 766 will be proceeded. If no, the 
recovered model 66 is needed to be modified and the step 765 will be 
proceeded. 

10 Step 765: modifying the sets of weight 669-666 to improve the quality of the 
recovered model 66. 

Step 766: adding 1 to the value of i in order to proceed to the next data. 

Step 767: checking if all the data is processed. If yes, the procedure it is 
finished. If no, the step 762 is proceeded. 

15 Step 768: checking if the recovered model 66 has been modified. If yes, 
the step 761 is proceeded. If no, the step 769 is proceeded. If the 
recovered model 66 has not been modified, it indicates that the 
recovered model 66 is ideal. This is also called the training of the 
recovered model. The more the training, the better the recovered 

20 model 66. 

Step 769: Outputting the recovered model of a single color ( i.e. Red or 
Green or Blue color). 

Step 77: checking if the recovered model of each of the single color has 
been processed. If no, step 72 is proceeded. If yes, step 78 is 
25 proceeded. The total of six recovered models of each of the three 
single colors are checked. 

Step 78:combining the six recovered models and outputting the recovered 
model 66. 

30 Figure 8 shows the flowchart of the operation for applying the recovery 
model to reduce the zipper of image data in this invention. 
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Step 81: inputting an input signal of an image data which is the mixed 
output signal 10 of Figure 2. 

Step 82: checking if the differences of the color grades between the two 
5 adjacent regions are big. If no, step 85 is proceeded and the input 

signal is outputted. If yes, step 83 is proceeded. 

Step 83: inputting the input signal into the recovered model. 

Step 84: recovering the input signal by using the recovered model 66 to 
reduce the zipper and producing an output signal 62. 

10 Step 85: outputting the output signal 62 which is a recovered image signal 
10'. 



The output of the recovered image signal 10' is shown in Figure 9. In 
the Figure 9, the zipper of the image data is reduced and the quality of the 
15 image data is improved. 

Figure lOA is a first embodiment of this invention. This first 
embodiment is a software type apparatus for reducing the zipper of the 
image data. The CCD outputs an input signal 61 into the software type 
apparatus 67. An example of the software type apparatus 67 is a CPU of a 
20 computer and corresponding software. The CPU uses the corresponding 
software, the recovered model 66, to reduce the zipper of the image data, 
and outputs the recovered signal 62 to the application software, such as 
Photoshop. 

Figure lOB shows a second embodiment of this invention. This 
25 second embodiment is a hardware type apparatus for reducing the zipper of 
the image data. The CCD outputs an input signal 61 to a first delay unit 
and the hardware type apparatus 67. The first delay unit outputs a first 
delayed signal to a second delay unit and the hardware type apparatus 67. 
The second delay unit outputs a second delayed signal to the hardware type 
30 apparatus 67. The hardware type apparatus 67 receives these three signals, 
uses the recovered model 66 to reduce the zipper and outputs the recovered 
signal 62. 
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Figure IOC shows the third embodiment of this invention. This 
embodiment is a firmware type apparatus 67 for reducing the zipper of 
image data. The CCD outputs an input signal 61 to the firmware type 
apparatus 67. The firmware type apparatus 67 uses the recovered model 66 
5 to reduce the zipper of the image data and outputs the recovered signal 62. 

While the present invention has been shown and described with 
reference to preferred embodiments thereof, and in terms of the illustrative 
drawings, it should be not considered as limited thereby. Various possible 
modification, omission, and alterations could be conceived of by one skilled 
10 in the art to the form and the content of any particular embodiment, without 
departing from the scope and the spirit of the present invention. 
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